Systems, Devices, and Methods for Providing Heat-Source Alerts

ABSTRACT

The various embodiments described herein include methods, devices, and systems for authenticating users. In one aspect, a method includes (1) determining an operating state of a heat source; (2) determining an occupancy of a dwelling that includes the heat source; (3) determining whether a heat-source alert condition is met; (4) in accordance with a determination that the heat-source alert condition is met, generating a heat-source alert; (5) receiving from a user acknowledgement of the heat-source alert, the acknowledgement including a first classification for the heat-source alert; and (6) determining that the acknowledgement includes the first classification for the heat-source alert; and (7) in accordance with the determination that the acknowledgement includes the first classification, modifying the heat-source alert condition for future heat-source alerts.

RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/621,272, filed Feb. 12, 2015, entitled “Devices and Methods forProviding Heat-Source Alerts,” which is hereby incorporated by referencein its entirety.

TECHNICAL FIELD

This relates generally to heat-source monitoring, including but notlimited to, providing heat-source alerts.

BACKGROUND

Heat sources (e.g., stoves and fireplaces) in a structure present a riskof fire. Sensors may be used to monitor heat sources and provide analert in the event of a fire and/or the presence of excessive heat.Sometimes a sensor will provide an unnecessary alert (e.g., a falsealarm). Repeated instances of unneeded alerts can lead a user to ignoreor disable the alerts, which defeats the purpose of the heat-sourcemonitor and reduces user safety.

SUMMARY

Accordingly, there is a need for devices and methods for providing moreaccurate heat-source alerts, with fewer instances of unneeded alerts.Such devices and methods optionally complement or replace conventionaldevices and methods for providing heat-source alerts.

In accordance with some embodiments, a method is performed at acomputing system. The method includes receiving blackbody radiation datafrom a thermal radiation sensor that is located in a room with a heatsource and is directed at the heat source. An operating state of theheat source in the room is determined based at least in part on thereceived blackbody radiation data. Occupancy data is received for adwelling that includes the room with the heat source. Based on thereceived occupancy data, an occupancy of the dwelling is determined.Determining the occupancy of the dwelling includes determining anoccupancy for the room with the heat source. Based at least in part onthe determined operating state of the heat source and the determinedoccupancy of the dwelling, including the occupancy of the room with theheat source, it is determined whether a heat-source alert condition ismet. The heat-source alert condition includes a first threshold time. Inaccordance with a determination that the heat-source alert condition ismet, a heat-source alert is presented or instructions to present aheat-source alert are sent. After presenting or sending instructions topresent the heat-source alert, a request of a first type is received tocancel the heat-source alert. In response, the heat-source alert iscanceled and the heat-source alert condition is modified.

In accordance with some embodiments, a computing system includes one ormore processors and memory. The memory stores one or more programsconfigured to be executed by the one or more processors. The one or moreprograms include instructions for performing the operations of themethod described above. In accordance with some embodiments, anon-transitory computer-readable storage medium has stored thereininstructions which when executed by a computing system with one or moreprocessors, cause the computing system to perform the operations of themethod described above. In accordance with some embodiments, a computingsystem includes means for performing the operations of the methoddescribed above.

Thus, computing systems are provided with more accurate methods forgiving heat-source alerts, with fewer instances of unneeded alerts. Suchmethods may complement or replace conventional methods for providingheat-source alerts.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the various described embodiments,reference should be made to the Description of Embodiments below, inconjunction with the following drawings in which like reference numeralsrefer to corresponding parts throughout the figures.

FIG. 1 is an exemplary smart home environment in accordance with someembodiments.

FIG. 2 is a block diagram illustrating an exemplary network architecturethat includes a smart home network in accordance with some embodiments.

FIG. 3 illustrates a network-level view of an extensible devices andservices platform with which the smart home environment of FIG. 1 isintegrated, in accordance with some embodiments.

FIG. 4 illustrates an abstracted functional view of the extensibledevices and services platform of FIG. 3, with reference to a processingengine as well as devices of the smart home environment, in accordancewith some embodiments.

FIG. 5 is a block diagram illustrating an exemplary smart device inaccordance with some embodiments.

FIG. 6 is a block diagram illustrating an exemplary computing system inaccordance with some embodiments.

FIG. 7 illustrates an exemplary graphical user interface shown on anelectronic device in accordance with some embodiments.

FIGS. 8, 9A, and 9B are flow diagrams illustrating methods of providingheat-source alerts in accordance with some embodiments.

DESCRIPTION OF EMBODIMENTS

As noted above, there is a need for devices and methods for providingmore accurate heat-source alerts, with fewer instances of unneededalerts. Here, a computing system generates a heat-source alert inresponse to a determination that a heat source in a room is in apotentially unsafe condition. This determination is based at least inpart on data from a thermal radiation sensor monitoring the heat sourceand also on occupancy data for a dwelling that includes the room. Thecombined thermal-radiation-sensor data and occupancy data may indicate,for example, that a room with a hot stove has been left unoccupied for alength of time that is considered unsafe. A safety hazard thus existsthat merits a heat-source alert. The same hot stove in an occupied room,however, might not be considered a safety hazard that merits aheat-source alert.

Furthermore, the computing system adjusts the condition used todetermine whether to provide a heat-source alert based on feedback fromrequests to cancel the heat-source alerts. For example, if an occupant'srequest to cancel a heat-source alert is of a type that indicates thatthe heat-source alert is a false alarm, the heat-source alert conditionmay be changed to reduce the likelihood of another false alarm (e.g.,lengthening the amount of time that a room is unoccupied before sendinga heat-source alert). Conversely, if an occupant's request to cancel aheat-source alert is of a type that indicates that the heat-source alertwas proper, but should have been given sooner, the heat-source alertcondition may be changed to shorten the amount of time that a room isunoccupied before sending a heat-source alert. Thus, the heat-sourcealert condition changes with time so that more accurate heat-sourcealerts are provided, with fewer instances of unneeded alerts or latealerts.

Below, FIGS. 1-4 provide an overview of exemplary smart home devicenetworks and capabilities. FIGS. 5 and 6 are block diagrams ofelectronic devices included in or in communication with a smart homeenvironment. FIG. 7 illustrates an exemplary user interface fordisplaying information relating to heat-source alerts. FIGS. 8, 9A, and9B are flow diagrams illustrating methods of providing heat-sourcealerts in accordance with some embodiments.

Reference will now be made in detail to embodiments, examples of whichare illustrated in the accompanying drawings. In the following detaileddescription, numerous specific details are set forth in order to providea thorough understanding of the various described embodiments. However,it will be apparent to one of ordinary skill in the art that the variousdescribed embodiments may be practiced without these specific details.In other instances, well-known methods, procedures, components,circuits, and networks have not been described in detail so as not tounnecessarily obscure aspects of the embodiments.

It will also be understood that, although the terms first, second, etc.are, in some instances, used herein to describe various elements, theseelements should not be limited by these terms. These terms are only usedto distinguish one element from another. For example, a first type ofrequest could be termed a second type of request, and, similarly, asecond type of request could be termed a first type of request, withoutdeparting from the scope of the various described embodiments. The firsttype of request and the second type of request are both types ofrequests, but they are not the same type of request.

The terminology used in the description of the various describedembodiments herein is for the purpose of describing particularembodiments only and is not intended to be limiting. As used in thedescription of the various described embodiments and the appendedclaims, the singular forms “a”, “an” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “includes,” “including,” “comprises,” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof.

As used herein, the term “if” is, optionally, construed to mean “when”or “upon” or “in response to determining” or “in response to detecting”or “in accordance with a determination that,” depending on the context.Similarly, the phrase “if it is determined” or “if [a stated conditionor event] is detected” is, optionally, construed to mean “upondetermining” or “in response to determining” or “upon detecting [thestated condition or event]” or “in response to detecting [the statedcondition or event]” or “in accordance with a determination that [astated condition or event] is detected,” depending on the context.

It is to be appreciated that “smart home environments” may refer tosmart environments for homes such as a single-family house, but thescope of the present teachings is not so limited. The present teachingsare also applicable, without limitation, to duplexes, townhomes,multi-unit apartment buildings, hotels, retail stores, office buildings,industrial buildings, and more generally any living space or work space.

It is also to be appreciated that while the terms user, customer,installer, homeowner, occupant, guest, tenant, landlord, repair person,and the like may be used to refer to the person or persons acting in thecontext of some particularly situations described herein, thesereferences do not limit the scope of the present teachings with respectto the person or persons who are performing such actions. Thus, forexample, the terms user, customer, purchaser, installer, subscriber, andhomeowner may often refer to the same person in the case of asingle-family residential dwelling, because the head of the household isoften the person who makes the purchasing decision, buys the unit, andinstalls and configures the unit, and is also one of the users of theunit. However, in other scenarios, such as a landlord-tenantenvironment, the customer may be the landlord with respect to purchasingthe unit, the installer may be a local apartment supervisor, a firstuser may be the tenant, and a second user may again be the landlord withrespect to remote control functionality. Importantly, while the identityof the person performing the action may be germane to a particularadvantage provided by one or more of the embodiments, such identityshould not be construed in the descriptions that follow as necessarilylimiting the scope of the present teachings to those particularindividuals having those particular identities.

FIG. 1 is an exemplary smart home environment 100 in accordance withsome embodiments. Smart home environment 100 includes a structure 150(e.g., a house, office building, garage, or mobile home) with variousintegrated devices. It will be appreciated that devices may also beintegrated into a smart home environment 100 that does not include anentire structure 150, such as an apartment, condominium, or officespace. Further, the smart home environment 100 may control and/or becoupled to devices outside of the actual structure 150. Indeed, severaldevices in the smart home environment 100 need not be physically withinthe structure 150. For example, a device controlling a pool heater 114or irrigation system 116 may be located outside of the structure 150.

The depicted structure 150 includes a plurality of rooms 152, separatedat least partly from each other via walls 154. The walls 154 may includeinterior walls or exterior walls. Each room may further include a floor156 and a ceiling 158. Devices may be mounted on, integrated with and/orsupported by a wall 154, floor 156 or ceiling 158.

In some embodiments, the integrated devices of the smart homeenvironment 100 include intelligent, multi-sensing, network-connecteddevices that integrate seamlessly with each other in a smart homenetwork (e.g., 202 FIG. 2) and/or with a central server or acloud-computing system to provide a variety of useful smart homefunctions. The smart home environment 100 may include one or moreintelligent, multi-sensing, network-connected thermostats 102(hereinafter referred to as “smart thermostats 102”), one or moreintelligent, network-connected, multi-sensing hazard detection units 104(hereinafter referred to as “smart hazard detectors 104”), and one ormore intelligent, multi-sensing, network-connected entryway interfacedevices 106 (hereinafter referred to as “smart doorbells 106”).

In some embodiments, the one or more smart thermostats 102 detectambient climate characteristics (e.g., temperature and/or humidity) andcontrol a HVAC system 103 accordingly. For example, a respective smartthermostat 102 includes an ambient temperature sensor.

The one or more smart hazard detectors 104 may include thermal radiationsensors directed at respective heat sources (e.g., a stove, oven, otherappliances, a fireplace, etc.). For example, a smart hazard detector 104in a kitchen 153 includes a thermal radiation sensor directed at astove/oven 112. A thermal radiation sensor may determine the temperatureof the respective heat source (or a portion thereof) at which it isdirected and may provide corresponding blackbody radiation data asoutput.

The smart doorbell 106 may detect a person's approach to or departurefrom a location (e.g., an outer door), control doorbell functionality,announce a person's approach or departure via audio or visual means,and/or control settings on a security system (e.g., to activate ordeactivate the security system when occupants go and come).

In some embodiments, the smart home environment 100 includes one or moreintelligent, multi-sensing, network-connected wall switches 108(hereinafter referred to as “smart wall switches 108”), along with oneor more intelligent, multi-sensing, network-connected wall pluginterfaces 110 (hereinafter referred to as “smart wall plugs 110”). Thesmart wall switches 108 may detect ambient lighting conditions, detectroom-occupancy states, and control a power and/or dim state of one ormore lights. In some instances, smart wall switches 108 may also controla power state or speed of a fan, such as a ceiling fan. The smart wallplugs 110 may detect occupancy of a room or enclosure and control supplyof power to one or more wall plugs (e.g., such that power is notsupplied to the plug if nobody is at home).

In some embodiments, the smart home environment 100 of FIG. 1 includes aplurality of intelligent, multi-sensing, network-connected appliances112 (hereinafter referred to as “smart appliances 112”), such asrefrigerators, stoves, ovens, televisions, washers, dryers, lights,stereos, intercom systems, garage-door openers, floor fans, ceilingfans, wall air conditioners, pool heaters, irrigation systems, securitysystems, space heaters, window AC units, motorized duct vents, and soforth. In some embodiments, when plugged in, an appliance may announceitself to the smart home network, such as by indicating what type ofappliance it is, and it may automatically integrate with the controls ofthe smart home. Such communication by the appliance to the smart homemay be facilitated by either a wired or wireless communication protocol.The smart home may also include a variety of non-communicating legacyappliances 140, such as old conventional washer/dryers, refrigerators,and the like, which may be controlled by smart wall plugs 110. The smarthome environment 100 may further include a variety of partiallycommunicating legacy appliances 142, such as infrared (“IR”) controlledwall air conditioners or other IR-controlled devices, which may becontrolled by IR signals provided by the smart hazard detectors 104 orthe smart wall switches 108.

In some embodiments, the smart home environment 100 includes one or morenetwork-connected cameras 118 that are configured to provide videomonitoring and security in the smart home environment 100. The cameras118 may be used to determine occupancy of the structure 150 and/orparticular rooms 152 in the structure 150, and thus may act as occupancysensors. For example, video captured by the cameras 118 may be processedto identify the presence of an occupant in the structure 150 (e.g., in aparticular room 152). Specific individuals may be identified based, forexample, on their appearance (e.g., height, face) and/or movement (e.g.,their walk/gate). The smart home environment 100 may additionally oralternatively include one or more other occupancy sensors (e.g., thesmart doorbell 106, smart doorlocks, touch screens, IR sensors,microphones, ambient light sensors, motion detectors, smart nightlights170, etc.). In some embodiments, the smart home environment 100 includesradio-frequency identification (RFID) readers (e.g., in each room 152 ora portion thereof) that determine occupancy based on RFID tags locatedon or embedded in occupants. For example, RFID readers may be integratedinto the smart hazard detectors 104.

The smart home environment 100 may also include communication withdevices outside of the physical home but within a proximate geographicalrange of the home. For example, the smart home environment 100 mayinclude a pool heater monitor 114 that communicates a current pooltemperature to other devices within the smart home environment 100and/or receives commands for controlling the pool temperature.Similarly, the smart home environment 100 may include an irrigationmonitor 116 that communicates information regarding irrigation systemswithin the smart home environment 100 and/or receives controlinformation for controlling such irrigation systems.

By virtue of network connectivity, one or more of the smart home devicesof FIG. 1 may further allow a user to interact with the device even ifthe user is not proximate to the device. For example, a user maycommunicate with a device using a computer (e.g., a desktop computer,laptop computer, or tablet) or other portable electronic device (e.g., amobile phone, such as a smart phone) 166. A webpage or application maybe configured to receive communications from the user and control thedevice based on the communications and/or to present information aboutthe device's operation to the user. For example, the user may view acurrent set point temperature for a device (e.g., a stove) and adjust itusing a computer. The user may be in the structure during this remotecommunication or outside the structure.

As discussed above, users may control smart devices in the smart homeenvironment 100 using a network-connected computer or portableelectronic device 166. In some examples, some or all of the occupants(e.g., individuals who live in the home) may register their device 166with the smart home environment 100. Such registration may be made at acentral server to authenticate the occupant and/or the device as beingassociated with the home and to give permission to the occupant to usethe device to control the smart devices in the home. An occupant may usetheir registered device 166 to remotely control the smart devices of thehome, such as when the occupant is at work or on vacation. The occupantmay also use their registered device to control the smart devices whenthe occupant is actually located inside the home, such as when theoccupant is sitting on a couch inside the home. It should be appreciatedthat instead of or in addition to registering devices 166, the smarthome environment 100 may make inferences about which individuals live inthe home and are therefore occupants and which devices 166 areassociated with those individuals. As such, the smart home environmentmay “learn” who is an occupant and permit the devices 166 associatedwith those individuals to control the smart devices of the home.

In some embodiments, in addition to containing processing and sensingcapabilities, devices 102, 104, 106, 108, 110, 112, 114, 116 and/or 118(collectively referred to as “the smart devices”) are capable of datacommunications and information sharing with other smart devices, acentral server or cloud-computing system, and/or other devices that arenetwork-connected. Data communications may be carried out using any of avariety of custom or standard wireless protocols (e.g., IEEE 802.15.4,Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.11a,WirelessHART, MiWi, etc.) and/or any of a variety of custom or standardwired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitablecommunication protocol, including communication protocols not yetdeveloped as of the filing date of this document.

In some embodiments, the smart devices serve as wireless or wiredrepeaters. In some embodiments, a first one of the smart devicescommunicates with a second one of the smart devices via a wirelessrouter. The smart devices may further communicate with each other via aconnection (e.g., network interface 160) to a network, such as theInternet 162. Through the Internet 162, the smart devices maycommunicate with a smart home provider server system 164 (also called acentral server system and/or a cloud-computing system herein). The smarthome provider server system 164 may be associated with a manufacturer,support entity, or service provider associated with the smart device(s).In some embodiments, a user is able to contact customer support using asmart device itself rather than needing to use other communicationmeans, such as a telephone or Internet-connected computer. In someembodiments, software updates are automatically sent from the smart homeprovider server system 164 to smart devices (e.g., when available, whenpurchased, or at routine intervals).

FIG. 2 is a block diagram illustrating an exemplary network architecture200 that includes a smart home network 202 in accordance with someembodiments. In some embodiments, the smart devices 204 in the smarthome environment 100 (e.g., devices 102, 104, 106, 108, 110, 112, 114,116 and/or 118) combine to create a mesh network in smart home network202. In some embodiments, one or more smart devices 204 in the smarthome network 202 operate as a smart home controller. In someembodiments, a smart home controller has more computing power than othersmart devices. In some embodiments, a smart home controller processesinputs (e.g., from smart devices 204, electronic device 166, and/orsmart home provider server system 164) and sends commands (e.g., tosmart devices 204 in the smart home network 202) to control operation ofthe smart home environment 100. In some embodiments, some of the smartdevices 204 in the smart home network 202 (e.g., in the mesh network)are “spokesman” nodes (e.g., 204-1) and others are “low-powered” nodes(e.g., 204-9). Some of the smart devices in the smart home environment100 are battery powered, while others have a regular and reliable powersource, such as by connecting to wiring (e.g., to 120V line voltagewires) behind the walls 154 of the smart home environment. The smartdevices that have a regular and reliable power source are referred to as“spokesman” nodes. These nodes are typically equipped with thecapability of using a wireless protocol to facilitate bidirectionalcommunication with a variety of other devices in the smart homeenvironment 100, as well as with the smart home provider server system164. In some embodiments, one or more “spokesman” nodes operate as asmart home controller. On the other hand, the devices that are batterypowered are the “low-power” nodes. These nodes tend to be smaller thanspokesman nodes and typically only communicate using wireless protocolsthat require very little power, such as Zigbee, 6LoWPAN, etc.

In some embodiments, some low-power nodes are incapable of bidirectionalcommunication. These low-power nodes send messages, but they are unableto “listen”. Thus, other devices in the smart home environment 100, suchas the spokesman nodes, cannot send information to these low-powernodes.

In some embodiments, some low-power nodes are capable of only a limitedbidirectional communication. For example, other devices are able tocommunicate with the low-power nodes only during a certain time period.

As described, in some embodiments, the smart devices serve as low-powerand spokesman nodes to create a mesh network in the smart homeenvironment 100. In some embodiments, individual low-power nodes in thesmart home environment regularly send out messages regarding what theyare sensing, and the other low-powered nodes in the smart homeenvironment—in addition to sending out their own messages—forward themessages, thereby causing the messages to travel from node to node(i.e., device to device) throughout the smart home network 202. In someembodiments, the spokesman nodes in the smart home network 202, whichare able to communicate using a relatively high-power communicationprotocol, such as IEEE 802.11, are able to switch to a relativelylow-power communication protocol, such as IEEE 802.15.4, to receivethese messages, translate the messages to other communication protocols,and send the translated messages to other spokesman nodes and/or thesmart home provider server system 164 (using, e.g., the relativelyhigh-power communication protocol). Thus, the low-powered nodes usinglow-power communication protocols are able to send and/or receivemessages across the entire smart home network 202, as well as over theInternet 162 to the smart home provider server system 164. In someembodiments, the mesh network enables the smart home provider serversystem 164 to regularly receive data from most or all of the smartdevices in the home, make inferences based on the data, facilitate statesynchronization across devices within and outside of the smart homenetwork 202, and send commands back to one or more of the smart devicesto perform tasks in the smart home environment.

As described, the spokesman nodes and some of the low-powered nodes arecapable of “listening.” Accordingly, users, other devices, and/or thesmart home provider server system 164 may communicate control commandsto the low-powered nodes. For example, a user may use the electronicdevice 166 (e.g., a smart phone) to send commands over the Internet tothe smart home provider server system 164, which then relays thecommands to one or more spokesman nodes in the smart home network 202.The spokesman nodes may use a low-power protocol to communicate thecommands to the low-power nodes throughout the smart home network 202,as well as to other spokesman nodes that did not receive the commandsdirectly from the smart home provider server system 164.

In some embodiments, a smart nightlight 170 (FIG. 1), which is anexample of a smart device 204, is a low-power node. In addition tohousing a light source, the smart nightlight 170 houses an occupancysensor, such as an ultrasonic or passive IR sensor, and an ambient lightsensor, such as a photo resistor or a single-pixel sensor that measureslight in the room. In some embodiments, the smart nightlight 170 isconfigured to activate the light source when its ambient light sensordetects that the room is dark and when its occupancy sensor detects thatsomeone is in the room. In other embodiments, the smart nightlight 170is simply configured to activate the light source when its ambient lightsensor detects that the room is dark. Further, in some embodiments, thesmart nightlight 170 includes a low-power wireless communication chip(e.g., a ZigBee chip) that regularly sends out messages regarding theoccupancy of the room and the amount of light in the room, includinginstantaneous messages coincident with the occupancy sensor detectingthe presence of a person in the room. As mentioned above, these messagesmay be sent wirelessly (e.g., using the mesh network) from node to node(i.e., smart device to smart device) within the smart home network 202as well as over the Internet 162 to the smart home provider serversystem 164.

Other examples of low-power nodes include battery-operated versions ofthe smart hazard detectors 104. These smart hazard detectors 104 areoften located in an area without access to constant and reliable powerand may include any number and type of sensors, such as smoke/fire/heatsensors (e.g., thermal radiation sensors), carbon monoxide/dioxidesensors, occupancy/motion sensors, ambient light sensors, ambienttemperature sensors, humidity sensors, and the like. Furthermore, smarthazard detectors 104 may send messages that correspond to each of therespective sensors to the other devices and/or the smart home providerserver system 164, such as by using the mesh network as described above.

Examples of spokesman nodes include smart doorbells 106, smartthermostats 102, smart wall switches 108, and smart wall plugs 110.These devices 102, 106, 108, and 110 are often located near andconnected to a reliable power source, and therefore may include morepower-consuming components, such as one or more communication chipscapable of bidirectional communication in a variety of protocols.

In some embodiments, the smart home environment 100 includes servicerobots 168 (FIG. 1) that are configured to carry out, in an autonomousmanner, any of a variety of household tasks.

FIG. 3 illustrates a network-level view of an extensible devices andservices platform with which the smart home environment of FIG. 1 isintegrated, in accordance with some embodiments. The extensible devicesand services platform 300 includes smart home provider server system164. Each of the intelligent, network-connected devices described withreference to FIG. 1 (e.g., 102, 104, 106, 108, 110, 112, 114, 116 and118, identified simply as “devices” in FIGS. 2-4) may communicate withthe smart home provider server system 164. For example, a connection tothe Internet 162 may be established either directly (for example, using3G/4G connectivity to a wireless carrier), or through a networkinterface 160 (e.g., a router, switch, gateway, hub, or an intelligent,dedicated whole-home controller node), or through any combinationthereof.

In some embodiments, the devices and services platform 300 communicateswith and collects data from the smart devices of the smart homeenvironment 100. In addition, in some embodiments, the devices andservices platform 300 communicates with and collects data from aplurality of smart home environments across the world. For example, thesmart home provider server system 164 collects home data 302 from thedevices of one or more smart home environments 100, where the devicesmay routinely transmit home data or may transmit home data in specificinstances (e.g., when a device queries the home data 302). Exemplarycollected home data 302 includes, without limitation, power consumptiondata, blackbody radiation data, occupancy data, HVAC settings and usagedata, carbon monoxide levels data, carbon dioxide levels data, volatileorganic compounds levels data, sleeping schedule data, cooking scheduledata, inside and outside temperature humidity data, televisionviewership data, inside and outside noise level data, pressure data,video data, etc.

In some embodiments, the smart home provider server system 164 providesone or more services 304 to smart homes and/or third parties. Exemplaryservices 304 include, without limitation, software updates, customersupport, sensor data collection/logging, remote access, remote ordistributed control, and/or use suggestions (e.g., based on collectedhome data 302) to improve performance, reduce utility cost, increasesafety, etc. In some embodiments, data associated with the services 304is stored at the smart home provider server system 164, and the smarthome provider server system 164 retrieves and transmits the data atappropriate times (e.g., at regular intervals, upon receiving a requestfrom a user, etc.).

In some embodiments, the extensible devices and services platform 300includes a processing engine 306, which may be concentrated at a singleserver or distributed among several different computing entities withoutlimitation. In some embodiments, the processing engine 306 includesengines configured to receive data from the devices of smart homeenvironments 100 (e.g., via the Internet 162 and/or a network interface160), to index the data, to analyze the data and/or to generatestatistics based on the analysis or as part of the analysis. In someembodiments, the analyzed data is stored as derived home data 308.

Results of the analysis or statistics may thereafter be transmitted backto the device that provided home data used to derive the results, toother devices, to a server providing a webpage to a user of the device,or to other non-smart device entities. In some embodiments, usestatistics, use statistics relative to use of other devices, usepatterns, and/or statistics summarizing sensor readings are generated bythe processing engine 306 and transmitted. The results or statistics maybe provided via the Internet 162. In this manner, the processing engine306 may be configured and programmed to derive a variety of usefulinformation from the home data 302. A single server may include one ormore processing engines.

The derived home data 308 may be used at different granularities for avariety of useful purposes, ranging from explicit programmed control ofthe devices on a per-home, per-neighborhood, or per-region basis (forexample, demand-response programs for electrical utilities), to thegeneration of inferential abstractions that may assist on a per-homebasis (for example, an inference may be drawn that the homeowner hasleft for vacation and so security detection equipment may be put onheightened sensitivity), to the generation of statistics and associatedinferential abstractions that may be used for government or charitablepurposes. For example, processing engine 306 may generate statisticsabout device usage across a population of devices and send thestatistics to device users, service providers or other entities (e.g.,entities that have requested the statistics and/or entities that haveprovided monetary compensation for the statistics).

In some embodiments, to encourage innovation and research and toincrease products and services available to users, the devices andservices platform 300 exposes a range of application programminginterfaces (APIs) 310 to third parties, such as charities 314,governmental entities 316 (e.g., the Food and Drug Administration or theEnvironmental Protection Agency), academic institutions 318 (e.g.,university researchers), businesses 320 (e.g., providing devicewarranties or service to related equipment, targeting advertisementsbased on home data), utility companies 324, and other third parties. TheAPIs 310 are coupled to and permit third-party systems to communicatewith the smart home provider server system 164, including the services304, the processing engine 306, the home data 302, and the derived homedata 308. In some embodiments, the APIs 310 allow applications executedby the third parties to initiate specific data processing tasks that areexecuted by the smart home provider server system 164, as well as toreceive dynamic updates to the home data 302 and the derived home data308.

For example, third parties may develop programs and/or applications,such as web applications or mobile applications, that integrate with thesmart home provider server system 164 to provide services andinformation to users. Such programs and applications may be, forexample, designed to help users reduce energy consumption, topreemptively service faulty equipment, to prepare for high servicedemands, to track past service performance, etc., and/or to performother beneficial functions or tasks.

FIG. 4 illustrates an abstracted functional view 400 of the extensibledevices and services platform 300 of FIG. 3, with reference to aprocessing engine 306 as well as devices of the smart home environment,in accordance with some embodiments. Even though devices situated insmart home environments will have a wide variety of different individualcapabilities and limitations, the devices may be thought of as sharingcommon characteristics in that each device is a data consumer 402 (DC),a data source 404 (DS), a services consumer 406 (SC), and a servicessource 408 (SS). Advantageously, in addition to providing controlinformation used by the devices to achieve their local and immediateobjectives, the extensible devices and services platform 300 may also beconfigured to use the large amount of data that is generated by thesedevices. In addition to enhancing or optimizing the actual operation ofthe devices themselves with respect to their immediate functions, theextensible devices and services platform 300 may be directed to“repurpose” that data in a variety of automated, extensible, flexible,and/or scalable ways to achieve a variety of useful objectives. Theseobjectives may be predefined or adaptively identified based on, e.g.,usage patterns, device efficiency, and/or user input (e.g., requestingspecific functionality).

FIG. 4 shows processing engine 306 as including a number of processingparadigms 410. In some embodiments, processing engine 306 includes amanaged services paradigm 410 a that monitors and manages primary orsecondary device functions. The device functions may include ensuringproper operation of a device given user inputs, estimating that (e.g.,and responding to an instance in which) an intruder is or is attemptingto be in a dwelling, detecting a failure of equipment coupled to thedevice (e.g., a light bulb having burned out), implementing or otherwiseresponding to energy demand response events, providing a heat-sourcealert, and/or alerting a user of a current or predicted future event orcharacteristic. In some embodiments, processing engine 306 includes anadvertising/communication paradigm 410 b that estimates characteristics(e.g., demographic information), desires and/or products of interest ofa user based on device usage. Services, promotions, products or upgradesmay then be offered or automatically provided to the user. In someembodiments, processing engine 306 includes a social paradigm 410 c thatuses information from a social network, provides information to a socialnetwork (for example, based on device usage), and/or processes dataassociated with user and/or device interactions with the social networkplatform. For example, a user's status as reported to their trustedcontacts on the social network may be updated to indicate when the useris home based on light detection, security system inactivation or deviceusage detectors. As another example, a user may be able to sharedevice-usage statistics with other users. In yet another example, a usermay share HVAC settings that result in low power bills and other usersmay download the HVAC settings to their smart thermostat 102 to reducetheir power bills.

In some embodiments, processing engine 306 includes achallenges/rules/compliance/rewards paradigm 410 d that informs a userof challenges, competitions, rules, compliance regulations and/orrewards and/or that uses operation data to determine whether a challengehas been met, a rule or regulation has been complied with and/or areward has been earned. The challenges, rules, and/or regulations mayrelate to efforts to conserve energy, to live safely (e.g., reducing theoccurrence of heat-source alerts) (e.g., reducing exposure to toxins orcarcinogens), to conserve money and/or equipment life, to improvehealth, etc. For example, one challenge may involve participants turningdown their thermostat by one degree for one week. Those participantsthat successfully complete the challenge are rewarded, such as withcoupons, virtual currency, status, etc. Regarding compliance, an exampleinvolves a rental-property owner making a rule that no renters arepermitted to access certain owner's rooms. The devices in the roomhaving occupancy sensors may send updates to the owner when the room isaccessed.

In some embodiments, processing engine 306 integrates or otherwise usesextrinsic information 412 from extrinsic sources to improve thefunctioning of one or more processing paradigms. Extrinsic information412 may be used to interpret data received from a device, to determine acharacteristic of the environment near the device (e.g., outside astructure that the device is enclosed in), to determine services orproducts available to the user, to identify a social network orsocial-network information, to determine contact information of entities(e.g., public-service entities such as an emergency-response team, thepolice or a hospital) near the device, to identify statistical orenvironmental conditions, trends or other information associated with ahome or neighborhood, and so forth.

FIG. 5 is a block diagram illustrating an exemplary smart device 204 inaccordance with some embodiments (e.g., a smart hazard detector 104,such as a thermal radiation sensor) (e.g., a camera 118 or otheroccupancy sensor). The smart device 204 typically includes one or moreprocessing units (processors or cores) 502, one or more network or othercommunications interfaces 504, memory 506, and one or more communicationbuses 508 for interconnecting these components. The communication buses508 optionally include circuitry (sometimes called a chipset) thatinterconnects and controls communications between system components. Insome embodiments, the smart device 204 includes a user interface 510.The user interface 510 may include a display device 512. In someembodiments, the device 204 includes one or more inputs 516 (e.g., inputbuttons, a keyboard, a mouse, and/or other inputs). In some embodiments,the smart device 204 includes a 3D gesture sensor for touchless gesturecontrol. Alternatively or in addition, in some embodiments, the displaydevice 512 includes a touch-sensitive surface 514, in which case thedisplay device 512 is a touch-sensitive display. In some embodiments,the user interface 510 also includes an audio output device 518, such asspeakers or an audio output connection connected to speakers, earphones,or headphones. Furthermore, some smart devices 204 use a microphone andvoice recognition to supplement or replace the keyboard. Optionally, thesmart device 204 includes an audio input device 520 (e.g., a microphone)to capture audio (e.g., speech from a user). Optionally, the smartdevice 204 includes a location detection device 521, such as a GPS(Global Positioning System), BLE (Bluetooth Low Energy), or othergeo-location receiver, for determining the location of the smart device204. The smart device 204 also optionally includes an image/videocapture device 524 (e.g., a camera 118), which may serve as an occupancysensor.

In some embodiments, the smart device 204 includes one or more thermalradiation sensors 522, directed at a heat source, that detect blackbodyradiation coming from the heat source. In some embodiments, the smartdevice 204 includes one or more occupancy sensors 523 (e.g., in additionto or as an alternative to the image/video capture device 524). In someembodiments, the smart device 204 includes one or more ambienttemperature sensors 525 (e.g., a thermometer) that measure the roomtemperature at the location of the smart device 204. A thermal radiationsensor 522 thus may measure the temperature of the heat source at whichit is directed, while an ambient temperature sensor 525 measures theroom temperature.

Memory 506 includes high-speed random access memory, such as DRAM, SRAM,DDR RAM or other random access solid state memory devices; and mayinclude non-volatile memory, such as one or more magnetic disk storagedevices, optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. Memory 506 may optionallyinclude one or more storage devices remotely located from theprocessor(s) 502. Memory 506, or alternately the non-volatile memorydevice(s) within memory 506, includes a non-transitory computer readablestorage medium. In some embodiments, memory 506 or the computer readablestorage medium of memory 506 stores the following programs, modules anddata structures, or a subset or superset thereof:

-   -   an operating system 526 that includes procedures for handling        various basic system services and for performing hardware        dependent tasks;    -   a network communication module 528 that is used for connecting        the smart device 204 to other computers via the one or more        communication network interfaces 504 (wired or wireless) and one        or more communication networks, such as smart home network 202        (e.g., a mesh network), the Internet, cellular telephone        networks, mobile data networks, other wide area networks, local        area networks, metropolitan area networks, and so on;    -   an image/video capture module 530 (e.g., a camera module) for        processing a respective image or video captured by the        image/video capture device 524, where the respective image or        video may be sent or streamed (e.g., by a client application        module 536) to the smart home network 202 and/or smart home        provider server system 164;    -   an audio input module 532 (e.g., a microphone module) for        processing audio captured by the audio input device 520, where        the respective audio may be sent or streamed (e.g., by a client        application module 536) to the smart home network 202 and/or        smart home provider server system 164;    -   a thermal-radiation data module 534 for processing        thermal-radiation data (i.e., blackbody radiation data) captured        by the thermal radiation sensor 522, where the data may be sent        or streamed through the smart home network 202 to a portable        electronic device 166, smart home provider server system 164,        other smart device 204, and/or other computing system;    -   an occupancy data module 536 for processing data captured by the        image/video capture device 524 and/or occupancy sensor 523,        where the data may be sent or streamed through the smart home        network 202 to a portable electronic device 166, smart home        provider server system 164, other smart device 204, and/or other        computing system;    -   an ambient temperature data module 536 for processing data        captured by the ambient temperature sensor 525, where the data        may be sent or streamed through the smart home network 202 to a        portable electronic device 166, smart home provider server        system 164, other smart device 204, and/or other computing        system;    -   a location detection module 538 (e.g., a GPS, Wi-Fi, or hybrid        positioning module) for determining the location of the smart        device 204 (e.g., using the location detection device 522) and        providing this location information to the smart home network        202 and/or smart home provider server system 164; and    -   one or more application modules 540, including the following        modules (or sets of instructions), or a subset or superset        thereof:        -   a smart home module 542 for providing an interface to a            smart home application (e.g., a stand-alone application or            an application in communication with another device in smart            home network 202 and/or smart home provider server system            164) and related features;        -   an occupancy-determination module 544 for determining            occupancy of a room in the structure 150 in which the smart            device 204 is located, and/or respective rooms 152 of the            structure 150 (e.g., based on occupancy data received from            the image/video capture device 524, the occupancy sensor            523, and/or other smart devices 204 in different rooms 152);        -   a heat-source operating-state determination module 546 to            determine an operating state of a heat source (e.g., using            data from the thermal radiation sensor 222 or a            thermal-radiation data module 534 of another smart device            204, and/or data from the ambient temperature sensor 525 or            an ambient-temperature data module 537 of another smart            device 204); and/or        -   a heat-source alert module 548 to provide heat-source alerts            based on the heat-source operating state (e.g., as            determined by the module 546) and the occupancy (e.g., as            determined by the module 544), in accordance with a            heat-source alert condition 550 that may be updated            dynamically based on user feedback.

FIG. 6 is a block diagram illustrating an exemplary computing system 600in accordance with some embodiments. In some embodiments, the computingsystem 600 is a computer or other portable electronic device 166. Insome embodiments, the computing system 600 is the smart home providerserver system 164 or another server system outside of the structure 150.In some embodiments, the computing system 600 is a stand-alonecontroller (e.g., located in the structure 150) that is distinct fromthe smart devices 204 and the smart home provider server system 164. Insome embodiments, the computing system 600 is a smart device 204 (e.g.,with additional components as shown in FIG. 5) or a collection ofmultiple smart devices 204. For example, the computing system 600 mayhave a housing that contains the components shown in FIG. 6 and alsocontains a smart hazard detector 204 (e.g., a thermal radiation sensor),at least one occupancy sensor (e.g., a camera 118 or other occupancysensor), and/or an ambient temperature sensor. In some embodiments, thecomputing system 600 is integrated with a heat source (e.g., in a singleappliance such as a stove or oven). One or more sensors (e.g., includinga thermal radiation sensor, ambient temperature sensor, and/or occupancysensor) may be integrated with the heat source and computing system 600.For example, the computing system 600, a thermal radiation sensor, and aheat source (e.g., a stove/oven) are contained in a single enclosure.

The computing system 600 typically includes one or more processing units(processors or cores) 602, one or more network or other communicationsinterfaces 604, memory 606, and one or more communication buses 608 forinterconnecting these components. The communication buses 608 optionallyinclude circuitry (sometimes called a chipset) that interconnects andcontrols communications between system components. In some embodiments,the computing system 600 includes a user interface 605 (e.g., which isanalogous to the user interface 510, FIG. 5).

Memory 606 includes high-speed random access memory, such as DRAM, SRAM,DDR RAM or other random access solid state memory devices; and mayinclude non-volatile memory, such as one or more magnetic disk storagedevices, optical disk storage devices, flash memory devices, or othernon-volatile solid state storage devices. Memory 606 may optionallyinclude one or more storage devices remotely located from theprocessor(s) 602. Memory 606, or alternately the non-volatile memorydevice(s) within memory 606, includes a non-transitory computer readablestorage medium. In some embodiments, memory 606 or the computer readablestorage medium of memory 606 stores the following programs, modules anddata structures, or a subset or superset thereof:

-   -   an operating system 610 that includes procedures for handling        various basic system services and for performing        hardware-dependent tasks;    -   a network communication module 612 that is used for connecting        the computing system 600 to other computers via the one or more        communication network interfaces 604 (wired or wireless) and one        or more communication networks, such as smart home network 202        (e.g., a mesh network), the Internet 162, cellular telephone        networks, mobile data networks, other wide area networks, local        area networks, metropolitan area networks, and so on;    -   a database 614 that includes the following data:        -   occupancy information 616 (e.g., received from occupancy            data modules 536 in respective smart devices 204, FIG. 5);        -   thermal radiation (i.e., blackbody radiation) information            618 (e.g., received from thermal radiation data modules 534            in respective smart devices 204, FIG. 5); and/or        -   ambient-temperature information 619 (e.g., received from            ambient-temperature data modules 537 in respective smart            devices 204, FIG. 5).    -   one or more application modules 620, including the following        modules (or sets of instructions), or a subset or superset        thereof:        -   an occupancy-determination module 622 for determining            occupancy of the structure 150 and/or respective rooms 152            of the structure 150 (e.g., based on the occupancy            information 616 in the database 614);        -   a heat-source operating-state determination module 624 to            determine an operating state of a heat source (e.g., based            on the thermal-radiation information 618 and/or            ambient-temperature information 619 in the database 614);            and/or        -   a heat-source alert module 626 to provide heat-source alerts            based on the heat-source operating state (e.g., as            determined by the module 624) and occupancy (e.g., as            determined by the module 622), in accordance with a            heat-source alert condition 628 that may be updated            dynamically based on user feedback.

Each of the above identified modules and applications of FIGS. 5 and 6corresponds to a set of executable instructions for performing one ormore functions described above and the methods described in thisapplication (e.g., the computer-implemented methods and otherinformation processing methods described herein). These modules (i.e.,sets of instructions) need not be implemented as separate softwareprograms, procedures or modules, and thus various subsets of thesemodules are, optionally, combined or otherwise re-arranged in variousembodiments. In some embodiments, memory 506 and/or 606 store a subsetof the modules and data structures identified above. Furthermore, memory506 and/or 606 optionally store additional modules and data structuresnot described above.

Attention is now directed towards embodiments of graphical userinterfaces (“GUIs”) and associated processes that may be implemented onan electronic device to present heat-source alerts and allow a user torespond to (e.g., cancel) heat-source alerts.

FIG. 7 illustrates an exemplary GUI 704 displayed on a screen 702 of aportable electronic device 166 (or other computing system, such as asmart device 204) in accordance with some embodiments. The GUI 704illustrates aspects of operations in the methods 800 (FIG. 8) and 900(FIGS. 9A-9B). In some embodiments, the screen 702 is an example of auser interface 605 (FIG. 6). In some embodiments, the screen 702 is anexample of a display 512 (FIG. 5) of a smart device 204. In someembodiments, the GUI 704 is generated based on information from acomputing system 600 (FIG. 6).

The GUI 704 displays a heat-source alert 706, which in this exampleindicates that the stove 112 (FIG. 1) is on and unattended. The GUI 704also presents user-interface elements 708, 710, and/or 712 that allowthe user to cancel the heat-source alert. Selection of the element 708(e.g., through an appropriate gesture on the screen 702, such as a tap)cancels the heat-source alert 706 and indicates that the heat-sourcealert 706 was valid. Selection of the element 710 cancels theheat-source alert 706 and indicates that the heat-source alert 706 was afalse alarm. Selection of the element 712 cancels the heat-source alert706 and indicates that the heat-source alert 706 was valid but was latein being presented. If the heat-source alert 706 was provided by anotherdevice (e.g., a computing system 600, FIG. 6) that instructed theportable electronic device 166 to display the heat-source alert 706,user feedback associated with selection of an element 708, 710, or 712is transmitted to that device (e.g., to the computing system 600).

FIG. 8 is a flow diagram illustrating a method 800 of providingheat-source alerts in accordance with some embodiments. Respectiveportions of the method 800 are performed by smart devices 204 (FIGS. 2,5) and a computing system 600 (FIG. 6). The method 800 corresponds toinstructions stored in one or more non-transitory computer-readablestorage media. For example, the portions performed by smart devices 204correspond to instructions stored in memories 506 (FIG. 5) and theportions performed by the computing system 600 correspond toinstructions stored in the memory 606 (FIG. 6). Examples and details ofthe portion of the method 800 performed by the computing system 600 areprovided below in the method 900 (FIGS. 9A-9B).

A thermal radiation sensor (e.g., a smart hazard detector 104) directedat a heat source (e.g., a stove, oven, other appliance, or fireplace) ina room (e.g., a kitchen or living room) sends (802) blackbody radiationdata (e.g., indicating the temperature of the heat source), which isreceived (804) by the computing system 600. The computing system 600determines (804) an operating state of the heat source based at least inpart on the blackbody radiation data. For example, the computing system600 determines whether the heat source is on or off and/or whether thetemperature of the heat source satisfies (e.g., exceeds, or equals orexceeds) a threshold temperature.

In some embodiments, the computing system 600 also receives ambienttemperature data for the room with the heat source from an ambienttemperature sensor located in that room. The computing system 600optionally uses the ambient temperature data in determining theoperating state of the heat source.

One or more occupancy sensors (e.g., cameras 118 and/or other occupancysensors) send (806) occupancy data for a dwelling that includes the roomwith the heat source. The computing system 600 receives (808) this dataand determines an occupancy of the dwelling, including an occupancy ofthe room with the heat source. The one or more occupancy sensors thusmay include an occupancy sensor in the room with the heat source. Theoccupancy data may or may not be received at the same time as theblackbody radiation data.

The computing system 600 determines (810) that a heat-source alertcondition is met, based at least in part on the determined operatingstate of the heat source and the determined occupancy of the dwelling,including the occupancy of the room with the heat source. Theheat-source alert condition includes a first threshold time. Forexample, the heat-source alert condition requires the heat source to bein a specified operating state (e.g., on) (e.g., having a temperaturethat satisfies a threshold) for a specified period of time while theroom with the heat source has a specified occupancy state (e.g.,unoccupied). The heat-source alert condition thus applies the firstthreshold time to both a specified operating state of the heat sourceand a specified occupancy state of the room or structure, in accordancewith some embodiments. In some embodiments, the specified period of timeis measured in minutes (e.g., is in the range of 5-15 minutes).

In response to determining (810) that the heat-source alert condition ismet, the computing system 600 presents (812) or sends instructions topresent a heat-source alert. In some embodiments, the operation 812includes displaying a flashing light or other visual warning in one ormore rooms, sounding an audible warning (e.g., “Check the stove” or “Thestove is on and unattended”) in one or more rooms, and/or sending anotification (e.g., a text message or email) to one or more occupants ofthe structure or to a third party (e.g., a caregiver of an occupant or ahome security provider). The heat-source alert 706 (FIG. 7) is anexample of such a notification.

An electronic device (e.g., a portable electronic device 166 or smartdevice 204) sends (814) a request to cancel the heat-source alert, basedon a corresponding user input (e.g., a user input provided through thetouch-sensitive surface 514 or an input 516, FIG. 5). Alternatively, theuser input is provided directly to the computing system 600, through aninput device of the computing system 600 (e.g., through a user interface605).

The request may be of a first type or a second type. In someembodiments, a request of the first type results from a first type ofactivation of a cancel button or touch-sensitive surface, while arequest of the second type results from a second type of activation ofthe cancel button or touch-sensitive surface. For example, the firsttype of activation of the cancel button or touch-sensitive surface is apress-and-hold or double-tap gesture, while the second type ofactivation of the cancel button or touch-sensitive surface is asingle-tap gesture (or vice versa). In another example, the first typeof activation is selection of the user-interface element 710 (FIG. 7),while the second type of activation is selection of the user-interfaceelement 708 (FIG. 7). In some embodiments, requests result fromtouchless user gestures: a request of the first type results from afirst type of user gesture in the air (e.g., a wave) while a request ofthe second type results from a second type of user gesture in the air(e.g., a thumbs-up gesture). In some embodiments, a request of the firsttype results from a first type of voice command (e.g., a user says“false alarm”) while a request of the second type results from a secondtype of voice command (e.g., a user says “cancel”). In some embodiments,valid voice commands are limited to voice commands provided by anoccupant who is determined to be in the same room as the heat source.

The computing system 600 receives (816) the request. If the request isof the first type, the computing system 600 cancels (816) theheat-source alert and modifies the heat-source alert condition. Examplesof modifying the heat-source alert condition are provided below withrespect to operation 926 (FIG. 9B) of the method 900. If the request isof the second type, the computing system 600 cancels (816) theheat-source alert without modifying the heat-source alert condition.

FIGS. 9A and 9B are flow diagrams illustrating a method 900 of providingheat-source alerts in accordance with some embodiments. The method 900is performed by a computing system 600 (FIG. 6) and corresponds toinstructions stored in a non-transitory computer-readable storage medium(e.g., memory 606, FIG. 6). The branch of the method 900 that assumes a“Yes” decision for operations 910/912 corresponds to the portions of themethod 800 (FIG. 8) performed by the computing system 600 (FIG. 6).

The computing system 600 receives (902, FIG. 9A) blackbody radiationdata from a thermal radiation sensor (e.g., a smart hazard detector 104)that is located in a room with a heat source (e.g., a stove/oven 112,other appliance, or fireplace) and is directed at the heat source. Thecomputing system 600 determines (904) an operating state of the heatsource in the room based at least in part on the received blackbodyradiation data. For example, the computing system 600 determines whetherthe heat source is on or off and/or whether the temperature of the heatsource satisfies (e.g., exceeds, or equals or exceeds) a thresholdtemperature.

In some embodiments, the computing system 600 also receives ambienttemperature data for the room with the heat source from an ambienttemperature sensor located in that room. The computing system 600optionally uses the ambient temperature data in determining theoperating state of the heat source.

The computing system 600 also receives (906) occupancy data (e.g., fromone or more cameras 118 and/or other occupancy sensors) for a dwellingthat includes the room with the heat source. The computing system 600determines (908) an occupancy of the dwelling, including an occupancyfor the room with the heat source, based on the received occupancy data.

The computing system 600 determines (910) whether a heat-source alertcondition is met, based at least in part on the operating state of theheat source and the occupancy of the dwelling, including the occupancyof the room with the heat source. The heat-source alert conditionincludes a first threshold time. For example, the heat-source alertcondition requires the heat source to be in a specified operating state(e.g., on) (e.g., having a temperature that satisfies a threshold) for aspecified period of time while the room with the heat source has aspecified occupancy state (e.g., unoccupied). The heat-source alertcondition thus applies the first threshold time to both a specifiedoperating state of the heat source and a specified occupancy state ofthe room or structure, in accordance with some embodiments. In someembodiments, the specified period of time is measured in minutes (e.g.,is in the range of 5-15 minutes).

If the heat-source alert condition is met (912-Yes), the computingsystem 600 presents (916) or sends instructions to present a heat-sourcealert. If the heat-source alert condition is not met (912-No), thecomputing system 600 does not present or send instructions to present aheat-source alert (i.e., foregoes presenting or sending instructions topresent a heat-source alert). Examples of heat-source alerts aredescribed with respect to operation 812 of the method 800 (FIG. 8).

Once a heat-source alert has been presented, or correspondinginstructions sent, the computing system 600 may receive (918) a requestto cancel the heat-source alert. Examples of requests are described withrespect to operation 814 of the method 800 (FIG. 8). The request may beof a first type or second type. If the request is of the second type(920-2nd type), the computing system 600 cancels (922) the heat-sourcealert and leaves the heat-source alert condition unmodified. If therequest is of the first type (922-1st type), the computing system 600cancels (924, FIG. 9B) the heat-source alert and modifies (926) theheat-source alert condition.

In some embodiments, modifying the heat-source alert condition includeschanging (928) the first threshold time to a second threshold time thatis greater than the first threshold time and/or changing (930) a firstthreshold temperature to a second threshold temperature that is greaterthan the first threshold temperature. A request of the first type mayindicate that the heat-source alert is a false alarm, while a request ofthe second type may indicate that the heat-source alert was appropriateand proper. The threshold temperature and/or threshold time may beincreased in response to a request of the first type to reduce thelikelihood of future false alarms occurring. The heat-source alertcondition thus may be tightened in response to requests of the firsttype, but not in response to requests of the second type.

Alternatively, in some embodiments modifying the heat-source alertcondition includes changing the first threshold time to a secondthreshold time that is less than the first threshold time and/orchanging the first threshold temperature to a second thresholdtemperature that is less than the first threshold temperature. A requestof the first type may indicate that a proper heat-source alert has beenprovided, but later than it should have been, while a request of thesecond type may indicate that the heat-source alert was appropriate andproper. The threshold temperature and/or threshold time may be decreasedin response to a request of the first type to ensure that futureheat-source alerts will be more prompt. The heat-source alert conditionthus may be relaxed in response to requests of the first type, but notin response to requests of the second type.

In some embodiments, the request may be of a first type, second type, orthird type. In one example, requests of the first, second, and thirdtypes correspond to selection of the user-interface elements 710, 708,and 712 (FIG. 7), respectively. A request of the first type indicatesthat the heat-source alert is a false alarm; in response, the computingsystem 600 tightens the heat-source alert condition (e.g., increases thethreshold temperature from the first threshold temperature to a second,higher threshold temperature and/or increases the threshold time fromthe first threshold time to a second, higher threshold time). A requestof the second type indicates that the heat-source alert was proper andtimely; in response, the computing system 600 does not modify theheat-source alert condition. A request of the third type indicates thatthe heat-source alert was proper but late; in response, the computingsystem 600 relaxes the heat-source alert condition (e.g., decreases thethreshold temperature from the first threshold temperature to a second,lower threshold temperature and/or decreases the threshold time from thefirst threshold time to a second, lower threshold time).

In some embodiments, modifying the heat-source alert condition includesassociating (932) a pattern of sensed household activity with therequest to cancel the heat-source alert and changing (934) theheat-source alert condition to additionally require an absence of thepattern.

Associating (932) the pattern of sensed household activity with therequest to cancel the heat-source alert may include monitoring theoccupancy (i.e., an occupancy condition) in each room (or one or morerooms) adjacent to the room with the heat source and monitoring a stateof at least one device in each adjacent room (or one or more adjacentrooms) that is occupied (i.e., for which occupancy is detected). Forexample, the computing system 600 detects movement of an occupant fromthe room with the heat source to an adjacent room and detectscorresponding activation of a device (e.g., a television) in theadjacent room (e.g., such that the device is activated upon entry of theoccupant into the adjacent room or within a predefined time afterentry). The computing system 600 also receives information regarding acategory of the activated device (e.g., information specifying that thedevice is a television). In response, the computing system 600 modifiesthe heat-source alert condition to preclude generation of a heat-sourcealert, even if all other requirements of the heat-source alert conditionare satisfied. The computing system 600 thus may adapt, for example, tothe desire of an occupant to watch television in a room adjacent to thekitchen while food cooks on the stove or in the oven. The occupant mightfind a heat-source alert provided in this situation to be an annoyance.

The method 900 may be performed repeatedly. In some embodiments, therequest received in operation 918 may be of the first type in someiterations of the method 900 and of the second type in other iterationsof the method 900. For example, a request of a first type may bereceived (918) during a first iteration of the method 900, in responseto a first heat-source alert resulting from a first determination thatthe heat-source alert condition is met, with the operations 924 and 926being performed accordingly. A request of a second type may be received(918) during a second iteration of the method 900, in response to asecond heat-source alert resulting from a second determination that theheat-source alert condition is met, with the operation 922 beingperformed accordingly.

In some embodiments, the request received in operation 918 may be of thefirst type in some iterations of the method 900, of the second type inother iterations of the method 900, and of the third type in still otheriterations of the method 900. In different iterations of the method 900,the heat-source alert condition would be tightened in response torequests of the first type, left unmodified in response to requests ofthe second type, and relaxed in response to requests of the third type.Respective heat-source alerts would be canceled regardless of the typeof the request.

For situations in which the systems discussed above collect informationabout users, the users may be provided with an opportunity to opt in/outof programs or features that may collect personal information (e.g.,information about a user's preferences or usage of a smart device). Inaddition, in some embodiments, certain data may be anonymized in one ormore ways before it is stored or used, so that personally identifiableinformation is removed. For example, a user's identity may be anonymizedso that the personally identifiable information cannot be determined foror associated with the user, and so that user preferences or userinteractions are generalized (for example, generalized based on userdemographics) rather than associated with a particular user.

Although some of various drawings illustrate a number of logical stagesin a particular order, stages that are not order dependent may bereordered and other stages may be combined or broken out. While somereordering or other groupings are specifically mentioned, others will beobvious to those of ordinary skill in the art, so the ordering andgroupings presented herein are not an exhaustive list of alternatives.Moreover, it should be recognized that the stages could be implementedin hardware, firmware, software or any combination thereof.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the scope of the claims to the precise forms disclosed. Manymodifications and variations are possible in view of the aboveteachings. The embodiments were chosen in order to best explain theprinciples underlying the claims and their practical applications, tothereby enable others skilled in the art to best use the embodimentswith various modifications as are suited to the particular usescontemplated.

What is claimed is:
 1. A method, comprising: at a computing systemcomprising one or more processors and memory coupled to the one or moreprocessors: determining an operating state of a heat source; determiningan occupancy of a dwelling that includes the heat source; determining,based on the determined operating state of the heat source and thedetermined occupancy of the dwelling, whether a heat-source alertcondition is met; in accordance with a determination that theheat-source alert condition is met, generating a heat-source alert;after generating the heat-source alert, receiving from a useracknowledgement of the heat-source alert, the acknowledgement includinga first classification of a plurality of classifications for theheat-source alert, wherein the plurality of classifications include afalse alarm classification and a valid alarm classification; and inresponse to receiving the acknowledgement of the heat-source alert,determining that the acknowledgement includes the first classificationfor the heat-source alert; and in accordance with the determination thatthe acknowledgement includes the first classification, modifying theheat-source alert condition for future heat-source alerts.
 2. The methodof claim 1, wherein modifying the heat-source alert condition includeschanging a first threshold time of the heat-source alert condition to asecond threshold time that is greater than the first threshold time. 3.The method of claim 1, wherein modifying the heat-source alert conditionincludes changing a first threshold temperature of the heat-source alertcondition to a second threshold temperature that is greater than thefirst threshold temperature.
 4. The method of claim 1, furthercomprising, in accordance with a determination that the heat-sourcealert condition is not met, forgoing generating the heat-source alert.5. The method of claim 1, wherein the determination that the heat-sourcealert condition is met is a first determination and the heat-sourcealert is a first heat-source alert, and the method further comprises: inaccordance with a second determination that the heat-source alertcondition is met, generating a second heat-source alert; aftergenerating the second heat-source alert, receiving a second useracknowledgement the second heat-source alert, the second useracknowledgement including a second classification for the secondheat-source alert; in response to receiving the second useracknowledgement for the second heat-source alert, cancelling the secondheat-source alert without modifying the heat-source alert condition. 6.The method of claim 1, further comprising: receiving ambient temperaturedata for a room with the heat source from an ambient temperature sensorlocated in the room with the heat source; and determining the operatingstate of the heat source in the room based at least in part on thereceived ambient temperature data.
 7. The method of claim 1, whereinmodifying the heat-source alert condition comprises: associating apattern of sensed household activity with the user acknowledgement; andchanging the heat-source alert condition to additionally require anabsence of the pattern.
 8. The method of claim 1, wherein determiningthe operating state of the heat source comprises determining theoperating state of the heat source based on blackbody radiation data. 9.The method of claim 1, wherein the plurality of classifications furtherinclude a late alarm classification indicating that the heat-sourcealert was not generated promptly enough.
 10. A computing system,comprising: one or more processors; and memory storing one or moreprograms configured to be executed by the one or more processors, theone or more programs comprising instructions for: determining anoperating state of a heat source; determining an occupancy of a dwellingthat includes the heat source; determining, based on the determinedoperating state of the heat source and the determined occupancy of thedwelling, whether a heat-source alert condition is met; in accordancewith a determination that the heat-source alert condition is met,generating a heat-source alert; after generating the heat-source alert,receiving from a user acknowledgement of the heat-source alert, theacknowledgement including a first classification of a plurality ofclassifications for the heat-source alert, wherein the plurality ofclassifications include a false alarm classification and a valid alarmclassification; and in response to receiving the acknowledgement of theheat-source alert, determining that the acknowledgement includes thefirst classification for the heat-source alert; and in accordance withthe determination that the acknowledgement includes the firstclassification, modifying the heat-source alert condition for futureheat-source alerts.
 11. The system of claim 10, wherein modifying theheat-source alert condition includes changing a first threshold time ofthe heat-source alert condition to a second threshold time that isgreater than the first threshold time.
 12. The system of claim 10,wherein modifying the heat-source alert condition includes changing afirst threshold temperature of the heat-source alert condition to asecond threshold temperature that is greater than the first thresholdtemperature.
 13. The system of claim 10, wherein the determination thatthe heat-source alert condition is met is a first determination and theheat-source alert is a first heat-source alert, and wherein the one ormore programs further comprise instructions for: in accordance with asecond determination that the heat-source alert condition is met,generating a second heat-source alert; after generating the secondheat-source alert, receiving a second user acknowledgement the secondheat-source alert, the second user acknowledgement including a secondclassification for the second heat-source alert; in response toreceiving the second user acknowledgement for the second heat-sourcealert, cancelling the second heat-source alert without modifying theheat-source alert condition.
 14. The system of claim 10, wherein the oneor more programs further comprise instructions for: receiving ambienttemperature data for a room with the heat source from an ambienttemperature sensor located in the room with the heat source; anddetermining the operating state of the heat source in the room based atleast in part on the received ambient temperature data.
 15. The systemof claim 10, wherein modifying the heat-source alert conditioncomprises: associating a pattern of sensed household activity with theuser acknowledgement; and changing the heat-source alert condition toadditionally require an absence of the pattern.
 16. The system of claim10, wherein the plurality of classifications further include a latealarm classification indicating that the heat-source alert was notgenerated promptly enough.
 17. A non-transitory computer-readablestorage medium storing one or more programs, the one or more programscomprising instructions, which when executed by a computing system,cause the computing system to: determine an operating state of a heatsource; determine an occupancy of a dwelling that includes the heatsource; determine, based on the determined operating state of the heatsource and the determined occupancy of the dwelling, whether aheat-source alert condition is met; in accordance with a determinationthat the heat-source alert condition is met, generate a heat-sourcealert; after generating the heat-source alert, receive from a useracknowledgement of the heat-source alert, the acknowledgement includinga first classification of a plurality of classifications for theheat-source alert, wherein the plurality of classifications include afalse alarm classification and a valid alarm classification; and inresponse to receiving the acknowledgement of the heat-source alert,determine that the acknowledgement includes the first classification forthe heat-source alert; and in accordance with the determination that theacknowledgement includes the first classification, modify theheat-source alert condition for future heat-source alerts.
 18. Thenon-transitory computer-readable storage medium of claim 17, whereinmodifying the heat-source alert condition includes changing a firstthreshold time of the heat-source alert condition to a second thresholdtime that is greater than the first threshold time.
 19. Thenon-transitory computer-readable storage medium of claim 17, whereinmodifying the heat-source alert condition includes changing a firstthreshold temperature of the heat-source alert condition to a secondthreshold temperature that is greater than the first thresholdtemperature.
 20. The non-transitory computer-readable storage medium ofclaim 17, wherein the plurality of classifications further include alate alarm classification indicating that the heat-source alert was notgenerated promptly enough.